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METHOD AND SYSTEM FOR IDENTIFYING 

AUTHORITATIVE INFORMATION 
RESOURCES IN AN ENVIRONMENT WITH 
CONTENT-BASED LINKS BETWEEN 
INFORMATION RESOURCES 

FIELD OF THE INVENTION 

The invention generally relates to the field of Information 
networks, communication, and information storage and 
retrieval. More specifically, the invention relates to the task 
of searching for items, among a networked collection of 
information resources, the items satisfying a desired crite- 
rion. The invention has particular applicability to hypertext/ 
byperlinked environments such as the World Wide Web. 

GLOSSARY OF TERMS USED 

While dictionary meanings are also implied by certain 
terms used here, the following glossary of some terms may 
be useful. 

Graphical User Interface (GUI): A computer user inter- 
face characterized by the visual "desktop'* paradigm, having 
images, windows, icons, and graphical menus representative 
of data objects, functions, or application programs, and 
utilizing a cursor, movable by a user input device such as a 
mouse, for selecting and manipulating the icons, etc., by 
clicking on mouse input buttons; as distinct from a 
character- or text-oriented user interface. 

Internet ("the Net"): A connection system that links 
computers worldwide in a network. 

TCP/IP: Transmission Control Protocol/Internet Protocol. 
A packet switching scheme the Internet uses to chop, route, 
and reconstruct the data it handles, from e-mail to video. 

World Wide Web (WWW, "the Web"): The Internet's 
multimedia application that lets people seeking information 
on the Internet switch from server to server and database to 
database by clicking on highlighted words or phrases of 
interest. An Internet Web server supports clients and pro- 
vides information. 

Home page: A multimedia table of contents that guides a 
Web user to stored information on the Internet. 

Server; A machine (computer) which performs a task at 
the command of another machine ("client"). In the context 
of the present invention, a server's primary function is to 
facilitate distribution of stored information over the Web. 

Client: A machine which provides commands to a server, 
and is serviced by the server. Typically, a client machine is 
operated by an end user, and functions responsive to user 
commands. 

Web Browser: A program running on a user-operated 
client computer. When a user "surfs" the Web using a 
browser, the browser acts as an Internet tour guide, allowing 
the client machine to display pictorial desktops, directories 
and search tools supported by the server. 

URL: Universal Resource Locator, a Web document ver- 
sion of an e-mail address, in character string form, which 
uniquely identifies a document, application, or tool available 
over the Web. 

Hyperlink; A network addressing tool embedded in a 
user-understandable displayed and/or highlighted item, such 
as a word, phrase, icon or picture. A URL can be accessed 
by means of its corresponding Hyperlink. When a user on a 
client machine selects the highlighted hyperlink through the 
user interface, the underlying item is then retrieved to the 
client supporting a Web browser. 
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HTTP Hypertext transfer protocol: Hypertext transfer 
protocol. The character string "http:" at the beginning of a 
URL indicates that the document or file designated by the 
URL contains hyperlinks defined according to the HTTP. 
5 HyperText Markup Language (HTML): HTML is the 
language used by Web servers to create and connect docu- 
ments that are viewed by Web clients. HTML uses Hypertext 
documents. Other uses of Hypertext documents are 
described in the following U.S. patents: 
io Bernstein et ai., U.S. Pat. No. 5,204,947, issued Apr. 20, 

1993; 

Bemstein et al, U.S. Pat. No. 5,297,249, issued Mar. 22, 
1994; and 

Lewis, U.S. Pat. No. 5,355,472, issued Oct. 11, 1994; 
15 all of which are assigned to International Business Machines 
Corporation, and which are referenced herein. 

BACKGROUND OF THE INVENTION 

In recent years, the technology of multimedia storage and 

20 interactive accessing has converged with that of network 
communications technologies, to present exciting prospects 
for users who seek access to remotely stored multimedia 
information. Particularly exciting has been the recent promi- 
nence of the Internet and its progeny, the World Wide Web. 

25 The Internet and the Web have captured the public imagi- 
nation as the so-called "information superhighway." Access- 
ing information through the Web has become known by the 
metaphorical term "surfing the Web." 

30 The Internet is not a single network, nor does it have any 
single owner or controller. Rather, the Internet is an unruly 
network of networks, a confederation of many different 
networks, public and private, big and small, whose human 
operators have agreed to connect to one another. 

35 The composite network represented by these networks 
relies on no single transmission medium. Bi-directional 
communication can occur via satellite links, fiber-optic 
trunk lines, phone lines, cable TV wires, and local radio 
links. However, no other communication medium is quite as 

40 ubiquitous or easy to access as the telephone network. The 
number of Web users has exploded, largely due to the 
convenience of accessing the Internet by coupling home 
computers, through modems, to the telephone network. As a 
consequence, many aspects of the Internet and the Web, such 

45 as network communication architectures and protocols, have 
evolved based around the premise that the communication 
medium may be one of limited bandwidth, such as the 
telephone network. 

To this point the Web has been used in industry predomi- 

50 nately as a means of communication, advertisement, and 
placement of orders. The Web facilitates user access to 
information resources by letting the user jump from one Web 
page, or from one server, to another, simply by selecting a 
highlighted word, picture or icon (a program object 

55 representation) about which the user wants more informa- 
tion. The programming construct which makes this maneu- 
ver possible is known as a "hyperlink". 

In order to explore the Web today, the user loads a special 
navigation program, called a "Web browser" onto his com- 

60 puter. A browser is a program which is particularly tailored 
for facilitating user requests for Web pages by implementing 
hyperlinks in a graphical environment. If a word or phrase, 
appearing on a Web page, is configured as an hyperlink to 
another Web page, the word or phrase is typically given in 

65 a color which contrasts with the surrounding text or 
background, underlined, or otherwise highlighted. 
Accordingly, the word or phrase defines a region, on the 
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graphical representation of the Web page, inside of which a 
mouse click will activate the hyperlink, request a download 
of the Iinked-to page, and display the page when it is 
downloaded. 

There are a number of browsers presently in existence and 5 
in use. Common examples are the NetScape, Microsoft, 
Mosaic, and IBM 's Web Explorer browsers. Browsers allow 
a user of a client to access servers located throughout the 
world for information which is stored therein. The informa- 
tion is then provided to the client by the server by sending 1Q 
files or data packets to the requesting client from the server's 
storage resources. 

Part of the functionality of a browser is to provide image 
or video data. Web still image or video information can be 
provided, through a suitably designed Web page or interface, 
to a user on a client machine. Still images can also be used 
as Hypertext-type links, selectable by the user, for invoking 
other functions. For instance, a user may run a video clip by 
selecting a still image, 

A user of a Web browser who is researching a particular 
area of interest will often want to make a content-based 20 
search, over as many Web pages as practicable, to identify 
Web pages whose content relates to the area of interest. To 
meet this need, search engines have been developed, which 
execute keyword-based searches to find Web pages whose 
content satisfies logical constraints given in terms of the 25 
keywords. Examples are Yahoo and AltaVista. 

To be effective, a search engine must effectively identify 
content, capturing relevant pages and discarding irrelevant 
pages. This effectiveness relies partly on the user's skill at ^ 
crafting a keyword search command, and partly on the 
search engine's ability to avoid false hits and false misses. 
The latter factor is a function of the design of the search 
engine. 

Thus, an important design objective in an Internet/Web 35 
search engine is to facilitate the user's desire to find Web 
pages whose content matches what he/she desires. There is 
a significant need for systems and techniques which facili- 
tate higher quality search results. 

A number of current methods provide mechanisms for 40 
searching in such an environment. Most current methods in 
use perform searching by computing some type of similarity 
measure between the terms appearing in the user's query 
string and the words appearing in the set of pages. The pages 
that score highest under this similarity measure are then 45 
deemed to be the most relevant. 

In a hyper-text environment that is sufficiently large and 
unstructured, this approach has the following limitation. For 
queries that are sufficiently "general" in nature, a search 
based on term-matching can easily return several thousand 50 
pages that are highly "relevant" to the query, in the sense that 
they score highly under the term-based similarity measure. 
This results in a volume of output much greater than a 
human user can digest. 

There is a need, therefore, for techniques which allow a 55 
user to find, from among a large set of pages which are 
relevant in the sense of term matching, those fewer pages 
which can be of particular help to the user in his/her quest 
for desired information. 

Some conventional techniques have made use of pointers 60 
(e.g., hyperlinks) to and from an initial set of information 
items. See Kochtanek, "Document Clustering, Using Macro 
Retrieval Techniques," Journal of the American Society for 
Information Science, vol. 34, no. 5, September 1983, pp. 
356-359. However, there remains a need for further, more 65 
sophisticated techniques that produce better quality infor- 
mation for the user. 
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SUMMARY OF THE INVENTION 

It is therefore an object of the invention to provide a new 
strategy and technique for obtaining desired information in 
a hyperlink environment. 

It is a further object of the invention to find, from among 
a collection of information resources such as Web pages, 
where content-based links (e.g., hyperlinks) exist between 
different information resources, a set of information 
resources which satisfy a desired criterion. 

It is a further object of the invention to find, from among 
a collection of information resources such as Web pages, 
where content-based links (e.g., hyperlinks) exist between 
different information resources, a set of information 
resources which are, in a sense, "authoritative" as to a 
particular subject. 

It is a further object of the invention to find, from among 
a collection of information resources such as Web pages, 
where content-based links (e.g., hyperlinks) exist between 
different information resources, a set of information 
resources which are, in a sense, "authoritative" as to a 
particular subject, responsive to a query directed to that 
subject 

To achieve these and other objects, the present invention 
is directed to a method and system for automatically iden- 
tifying the most authoritative pages from among a large set 
of hyperlinked pages. (Note that the term "page" will be 
used for the sake of brevity, without limiting or detracting 
from the meaning denoted or implied by the broader term 
"information resources.") A user may use the invention if 
he/she has a page, whose content is of interest, and desires 
to find other pages which are authoritative as to that content 
of interest. 

Alternatively, the user might begin with a query, such as 
a keyword-based search strategy in a Web search engine, and 
retrieve a set of pages that satisfy that query. The invention 
is then utilized to find a set of pages which are authoritative 
as to the subject matter in the pages located. This set of 
pages produced by the invention may include a subset of the 
retrieved pages, as well as pages not retrieved but which are 
linked to pages that were retrieved. 

The method of the invention includes the following steps: 

First, an initial set of pages is obtained. The method may 
begin with a single page, where the content of that page is 
of interest, or with a group of pages, for instance produced 
as a result of a keyword-based query by a Web search 
engine. Because of the content-based links (e.g., hyperlinks) 
between the pages, there will be a certain number of 
additional pages linked to or from the single page, or group 
of pages. The initial set, then, includes the single page or 
group of pages, plus the linked pages. 

Then, authoritativeness information is obtained for the 
pages of the initial set. The authoritativeness information 
exists on a per page basis, and is related to the number of 
finks to or from the page. At first, the links are simply 
counted. In a preferred class of embodiments, however, a 
sequence of iterations are performed, in which the authori- 
tativeness information, in the form of scores such as numeri- 
cal scores, is produced, for each given page in each succes- 
sive iteration, by summing the scores, from the previous 
iteration, of pages linked to or from the given page. 
Preferably, the scores are normalized after each iteration. It 
can be proven that the scores obtained in this fashion will 
converge. 

Finally, "neighborhoods" or "communities" of pages are 
obtained from the resultant authoritativeness information. A 
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single neighborhood may be obtained, or several distinct 
neighborhoods may be obtained by partitioning the scores 
into ranges. 

The basic concept of the invention has applicability in 
numerous areas. For instance, in a population of computer 5 
network users, links may take the form of E-mail messages 
from one user to another. The invention may be practiced to 
define communities of users, within the population, which 
communicate with each other a lot, or to identify individual 
users, which are authoritative sources of information, based i° 
on the number of E-mail messages they receive, and from 
whom they are received. 

Another area in which the invention may be applied is the 
area of telephone call records. As above, certain telephone 
subscribers may be considered authoritative by virtue of 15 
receiving a large number of calls from a distinct segment of 
the telephone subscriber population. These population 
segments, and the authoritative subscribers, may be identi- 
fied through use of the invention. 

However, it is believed that the invention has particular 20 
applicability to the World Wide Web. A user, having interest 
in a particular area of subject matter and seeking Web pages 
related to that subject matter, may advantageously use the 
invention to locate authoritative pages on that subject matter. 

While the invention is primarily disclosed as a method, it 
will be understood by a person of ordinary skill in the art that 
an apparatus, such as a conventional data processor, includ- 
ing a CPU, memory, I/O, program storage, a connecting bus, 
and other appropriate components, could be programmed or 3Q 
otherwise designed to facilitate the practice of the method of 
the invention- Such a processor would include appropriate 
program means for executing the method of the invention. 

Also, an article of manufacture, such as a pre-recorded 
disk or other similar computer program product, for use with 35 
a data processing system, could include a storage medium 
and program means recorded thereon for directing the data 
processing system to facilitate the practice of the method of 
the invention. It will be understood that such apparatus and 
articles of manufacture also fall within the spirit and scope 40 
of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a flowchart illustrating a first preferred embodi- 
ment of the method of the invention. 45 

FIG. 2 is a flowchart showing, in more detail, a portion of 
the flowchart of FIG. 1. 

FIG. 3 is a schematic diagram of sets of pages for 
illustration of the steps executed by FIG. 2. 

FIGS. 4 and 5 are schematic diagrams illustrating steps of 50 
the flowchart of FIG. 1. 

FIG. 6 is a flowchart illustrating a second preferred 
embodiment of the method of the invention. 

FIG. 7 is a flowchart showing, in more detail, a portion of 
the flowchart of FIG. 6. 55 

DESCRIPTION OF THE PREFERRED 
EMBODIMENT 
GENERAL DISCUSSION OF "AUTHORITATIVENESS" 

In accordance with the invention, a searching method, or 60 
a search engine, goes beyond the notion of "relevance," 
judged in terms of satisfaction of a keyword search strategy, 
to the notion of "authoritativeness." 

As with the notion of relevance, the evaluation of authori- 
tativeness necessarily depends on human judgment. In other 65 
words, the notion of authoritativeness may be subjective, or 
may depend on a variety of factors. 
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However, in a large hyper-media environment, it is pos- 
sible to judge authoritativeness by making use of the judg- 
ment of users who have already created links in the envi- 
ronment. Thus it is our thesis here that, to a large extent, the 
authority, or authoritativeness, of a page can be determined 
by making use of the existing link structure of the environ- 
ment. Because the existing link structure is objectively 
observable, it is possible to automate the evaluation of 
authoritativeness. 

The method of the invention, in its preferred embodi- 
ments to be described below, is predicated on the notion that, 
in a hyper-media environment such as the World Wide Web, 
there are in fact two distinct types of authoritative pages that 
are of value to a user. Heretofore the terms "authority," 
"authoritative," etc., have been used genetically. In the 
discussion which follows, the terms will be used more 
specifically to denote one of the two distinct types. (Overall, 
it is hoped that the context of a given portion of the 
discussion will make clear whether the term is being used in 
the generic sense, or in the narrower sense.) 

First, there are pages that will be termed "authorities." 
Authority pages correspond intuitively to "definitive refer- 
ences" on the query topic, and receive a large amount of user 
traffic. In hyperlinked environments, an authority is prefer- 
ably a page to which there are links in a large number of 
other pages on related subject matter. An authority pages is 
regarded as authoritative as to a topic in the sense that it is 
the destination of a large number of links related to that 
subject matter. 

Second, there are pages that will be termed "hubs." A hub 
is a page containing a large number of links to other pages. 
Hub pages correspond intuitively to the "hot-lists," book- 
mark collections, and other compendia of resources that 
have been compiled by individual creators of pages. A hub 
page is regarded as authoritative in the sense that a large 
number of other related pages can be found by following its 
links. 

Authorities and hubs have what could be termed a self- 
reinforcing relationship. That is, if H is a set of pages that are 
potential hubs, then the pages that they point to the most 
become candidate authorities. Conversely, if A is a set of 
pages that are potential authorities, then the set of pages that 
point to them the most become candidate hubs. 

The method of the invention makes use of this relation- 
ship between hubs and authorities. Preferred embodiments 
of the invention are implemented as a method which itera- 
tively follows links backward to hubs and forward to 
authorities, keeping authoritativeness information, prefer- 
ably in the form of scores which reflect the number of links. 

It is possible to obtain useful results by running only a 
single iteration. In that case, it is not really meaningful to 
call the single execution an "iteration." Rather, the method 
simple executes a sequence of steps once, and then is 
finished. 

Successive iterations, however, cause the scores for the 
various pages to converge to a set of authorities and hubs, 
including a neighborhood having maximal scores. It can be 
proved that, upon successive iterations, the scores converge 
to final values, and that the resulting equilibrium state 
satisfies a precise version of the above self -reinforcing 
property of authorities and hubs. See F. Narin et al,, 
"Bibliometrics," Annual review of Information Science and 
Technology, White Plains, N.Y.: Knowledge Industry 
Publications, Inc., 1977, pp. 35-58. 

Note, by the way, that depending on the particular way in 
which scores are computed, they can have positive or 
negative values. The signs of the scores have no inherent 
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meaning, and are significant only to the extent that they 
identify distinct neighborhoods. 

The method can be directly extended to produce several, 
relatively disjoint, communities of authorities and hubs. The 
method of the invention, when practiced in such a fashion, 5 
serves a clustering function. That is, the more disjoint these 
communities are, the more they are capable of correspond- 
ing to intuitive partitions of the query topic. The partitions 
may be made according to various criteria, including both 
semantic distinctions and social "clustering" among creators JQ 
of hyper-links. 

FIRST EMBODIMENT — A SINGLE NEIGHBORHOOD 

Preferred embodiments of the iterative algorithm of the 
invention will now be described in more detail. The discus- 
sion of the first preferred embodiment will make use of 
FIGS. 1-5. 35 

FIG. 1 depicts the basic iterative algorithm of the inven- 
tion. Initially, a set of query parameters may be chosen, as 
suitable for the particular situation. For instance, as per step 
2, a number m of initial pages, a number T of iterations, and 
an output size k may be designated. 20 

One mode of operation for the algorithm is for a user to 
have in mind a search strategy, such as a logical combination 
of keywords, defining the desired subject matter. The basic 
concepts of defining keyword search strategies are well 
known, and will not be elaborated upon here. 2 s 

Alternately, the user may make use of any other method 
for generating an initial set of hyper-linked pages. For 
instance, if the user knows of one page with subject matter 
of interest, and seeks to find authoritative pages as to that 
subject matter, the initial set may be obtained merely by 3Q 
finding other pages linked to or from that page. 

In any event, the result will be an initial set P of pages. 

Referring to FIG. 1, the initial set P of pages containing 
the query string is computed, as above (step 4). Any suitable 
method of identifying the set P may be used. A preferred 
method is via a standard term-matching algorithm. The set 35 
P may be specified as to size, through the use of a selected 
parameter m, as discussed in connection with step 2. 

In accordance with the invention, the hyperlinks between 
different pages are used to determine the authoritativeness of 
pages which have been found. If a given search strategy 40 
finds a number of related pages, many of them are likely to 
have hyperlinks in common, either between each other or 
to/from other pages in common. If the search also captures 
a "false hit" of unrelated subject matter, that unrelated page 
will lack such hyperlinks in common. The invention takes 45 
advantage of this fact to establish the authoritativeness of a 
set of pages. 

Preferably, the initial set Pis used to establish a "neigh- 
borhood'* of common or interconnecting hyperlinks (step 6). 

In a preferred embodiment, the method (step 6) for 50 
constructing the neighborhood of the set P of pages is 
depicted in FIG. 2. The neighborhood itself is shown sche- 
matically in FIG. 3. FIGS. 2 and 3 will now be discussed, 
and afterward, the discussion of FIG. 1 will resume. 

Step 8 of FIG. 2 states that we begin with the set P of 55 
pages produced by step 4. That set is shown collectively as 
10 in FIG. 3. Individual pages 12 are shown schematically 
as small circles. Hyperlinks 14 are shown as arrows. A 
hyperlink 14 is in a page 12 if the tail end of the arrow 
touches that page, and the hyperlink 14 points to another 60 
page 12 touched by the head of the arrow. 

In step 16, a set Q (shown as 18 in FIG. 3) is obtained, 
consisting of all pages 12 which are pointed to by the pages 
12 in the set P 10. The set Q 18 is an initial set of pages 
which will be referred to as "authorities," meaning that a 65 
large number of other pages have links to the authority 
pages. 
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In step 20, a set R (shown as 22 in FIG. 3) is obtained, 
consisting of all pages 12 which point to the pages 12 in the 
set P 10. The set R 22 is an initial set of pages which will 
be referred to as "hubs," meaning that they contain a large 
number of links to authoritative pages. 

When such sets are constructed, since most of the pages 
12 making up the sets will likely relate to the desired subject 
matter, it will also likely be the case that pages in the sets Q 
18 and R 22 will have links to each other. One such link 24 
is shown, between pages 12 in the sets Q 18 and R 22. This 
exemplary link further illustrates the concept that a "hub" 
page (the page 12 in the set R 22 which is the source of the 
link 24) has a link to an "authority" page (the page 12 in the 
set Q 18 which is the destination of the link 24). 

Therefore, the neighborhood consists of all pages that 
either point to a page in the set P 10, or are pointed to by a 
page in the set P 10. In other words, the neighborhood 
includes the initial set of pages, an initial set of hub pages, 
and an initial set of authority pages. The neighborhood is 
defined in software, in a suitable manner for further 
processing, preferably using conventional database tech- 
niques such as graphing or metadata (step 26). To limit the 
size of the neighborhood, one can optionally impose an 
upper bound on the allowed number of pages pointing to any 
single page in P. 

Optionally, a graph such as that shown in FIG. 3 may be 
constructed for display, to allow the user to see the state of 
the query. 

Returning to FIG. 1, an iterative process is set up for 
refining the sets of hub and authority pages by alternately 
finding other pages that the pages of the neighborhood are 
linked to, and finding other pages that are linked to the pages 
of the neighborhood. The next several steps of FIG. 1 
illustrate a preferred way of doing so. 

In step 28, hub and authority vectors H and A are defined, 
where each term of each of the vectors corresponds with one 
of the pages in the neighborhood. The iterative algorithm is 
to operate on these vectors. 

In the preferred embodiment, the initial values of H and 
A are computed as follows, where u and v are pages in the 
neighborhood: 

The vector H is initialized as follows: 

H[v]*l if v belongs to P 

H[v]=0 if v does not belong to P 

A[v]=0 for all pages v 

The entries in these two vectors are now updated itcra- 
tively (step 30). One preferred method for performing this 
updating is given in flowchart form in the next several steps 
of FIG. 1, and depicted graphically in FIGS. 4 and 5. 

If u and v are pages, let u-*v denote the presence of a link 
from u to v. Then the values of the terms of the hub and 
authority vectors H and A are updated as follows: 
These two equations are shown respectively as steps 32 and 
34 in FIG. 1. Equation (1) is illustrated in FIG. 4, in which 
three pages ul, u2, and u3 have links to a page v. The 
authority vector's term A[v] for the page v is the sum of the 
hub vector values H[ul], H[u2], and H[u3] for the three 
pages ul, u2, and u3. 

Similarly, Equation (2) is illustrated in FIG. 5, in which a 
page v has links to 



15 



20 



25 



30 



35 



40 



45 



50 



55 



ARC919970008US2 



9 

tfM«-£>»[K] 



three pages ul, u2, and u3. The hub vector's term H[v] for 
the page v is the sum of the authority vector values A[ul], 
A[u2], and A[u3] for the three pages ul, u2, and u3. 

It will be seen that, as these iterations are performed, the 
values of the terms of the hub and authority vectors will 
increase. Accordingly, the vectors are preferably 
normalized, to prevent the numerical values from growing 
too large (step 36). One preferred normalization method is 
the following: 

At . A[v] (3) 
AM < 

H[v] < 

£*f«l 2 

M 

Following the normalization of step 36, the iteration is 
complete. Further iterations may follow as appropriate, such 
as by looping back T times, where T is the number of 
iterations specified in step 2. 

It will be seen that, as the successive iterations proceed, 
the hub and authority vector values will increase based on 
the number of links common to the page populations. The 
pages unrelated to the desired subject matter, which will 
have relatively few links to the pages related to the desired 
subject matter, will have relatively low values, and will, in 
effect, be "weeded out" 

When the iterations have been completed, FIG. 1 con- 
cludes by outputting its final results. A preferred output 
technique, given in steps 38 and 40, is to scan the hub and 
authority vectors H and A, to find the k largest terms, k 
having been specified in step 2, and being presumptively 
smaller than the number of pages identified. 

Note that steps 28-36 may be executed only a single time, 
and still obtain useful results. Depending on the particular 
situation in which the invention is to be practiced, a user may 
choose to run only a single iteration and accept the results as 
satisfactory, to run a relatively small number of iterations, 
such as a fixed number or a number required to reach some 
extrinsic limit such as a limit imposed by cost or other 
factors, or to run until convergence of the results is detected. 
SECOND EMBODIMENT — SEVERAL NEIGHBOR- 
HOODS 

The above -described method may be extended to locate 
several communities of authorities and hubs. Iterations are 
performed in essentially the same manner as described 
above, but now, several vectors of each type are maintained. 
For instance, if there are to be q hub vectors and q authority 
vectors, representing q number of distinct neighborhoods, 
then the hub and authority vectors are shown as distin- 
guished by index subscripts, as follows: A^, . . . , A^ and 

FIG. 6 is a flowchart, comparable to that of FIG. 1, 
showing a preferred embodiment of the invention where a 
plurality of neighborhoods are to be found. Certain steps 
which were shown in FIG. 1 have been omitted from FIG. 
6 for the sake of brevity. It will be understood, however, that 
these omitted steps are to be included, as appropriate. 
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Initially, the implementation of FIG. 6 chooses the addi- 
tional input parameter q, a number of neighborhoods (i.e., of 
hub and authority vectors) to be found (step 42). In step 44, 
initial values for the terms of the hub and authority vectors 
5 are set. 

However, the initialization is preferably performed in a 
different manner from what was done in step 28 of FIG. 1. 
The objective of this embodiment is to come up with distinct 
neighborhoods. Consequently, it is necessary that the final 

io result of the iterations be multiple distinct vectors. In order 
for the iterations to converge to multiple distinct vectors, it 
is necessary that no two of the vectors become equal during 
the course of the iterations. 

For this purpose, the vectors are initialized so as to be 

15 orthogonal. Moreover, following each iteration, they are 
again updated so as to remain orthogonal. This updating step 
can be accomplished by the standard Gram-Schmidt 
procedure, as given in G. Golub, C.F. Van Loan, "Matrix 
Computations", Johns Hopkins University Press, 1989. 

20 In light of the foregoing, the preferred embodiment of the 
invention is as follows: Before the iterations begin, in step 
46 the hub vectors are orthogonalized. The initial orthogo- 
nalization may conveniently be performed by assigning each 
coordinate a real-number value chosen uniformly at random 

25 from the interval [0,1]. 

The iterations are now performed (step 48). For a given 
iteration, the summing, similar to those given above in 
Equations (1) and (2), is done separately over each pair of 
hub and authority vectors (A,-, H t ). 

30 At the end of each iteration, the vectors are modified to be 
mutually orthogonal. This can be accomplished by the 
standard Gram-Schmidt procedure given in G. Golub 
(supra). 

A preferred sequence of the steps of an iteration are given 
35 in FIG. 6, as follows: In step 50, the authority vectors are 
updated. When they are all updated, they are then orthogo- 
nalized (step 52). Then, in step 54, the hub vectors are 
updated. When they are all updated, they are then orthogo- 
nalized (step 56). This completes an iteration. The iteration 
40 is repeated a desired number of times. 

As with the embodiment of FIG. 1, the largest (positive) 
entries of Aq and H 0 are returned as the primary hubs and 
authorities. One can then define 2q additional authority/hub 
communities, by taking the q most positive and the q most 
45 negative entries from each of the pairs of vectors (A,-, H f ), for 
i-1, . . . , q. 

Note that the Gram-Schmidt procedure, which includes 
subtractions, can produce negative values for vector terms. 
The positivity or negativity of the entries does not have a 

50 direct meaning in the context of the method. Rather, a more 
significant meaning is attributed to the magnitudes, i.e., 
absolute values, of the terms. In general, the more links to 
or from a page, or, more broadly, the greater the authorita- 
tiveness of the page as to the desired subject matter, the 

55 greater the magnitude of the value will be. 

The noteworthy property of the entries, taken as a group, 
is simply that they may be partitioned into two or more 
communities, based on their ranges of values. It may be 
convenient or desirable, where one set is positive and the 

60 other set is negative, to partition at the zero value. However, 
it is not crucial that the partitions be evenly distributed or 
symmetric. More generally, any subset of the communities 
can be returned, possibly according to additional criteria 
imposed by the user on the set of pages. 

65 For discussion purposes, however, an example will be 
given in which partitioning is to be symmetric about the zero 
point. 



